Wide-band and Air Dispersion Effecting the ABCD Algorithm of Phase- Recovery in 

Long-baseline Interferometry 
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Long-baseline interferometry detects fringes created by superposition of two beams of light col- 
lected by two telescopes pointing into a common direction. The external path difference generated 
by pointing away from the zenith is commonly compensated by adding a variable optical path length 
(delay) through air for one beam such that the optical path difference between the beams remains 
close to zero near the detector. 

The ABCD formula assigns a (wrapped) phase to the amplitudes A to D of an interference pattern 
shifted by multiples of 90 degrees in phase. We study the interplay between a wide band pass of 
the optics and the dispersion of the air in the compensating delay, which leads to small deviations 
between the ABCD phase and the reduced, monochromatic group-delay representation of the wave 
packets. 

In essence, this adds dispersion to the effects that have been discussed for evacuated interferom- 
eters (telescopes in space) before [J. Opt. Soc. Am. A 22 (2005) 2774]. 

PACS numbers: 95.75.Kk,95.55.Br,95.85.Hp,42.30.Rx 

Keywords: Optical Interferometry; Group Delay; Air Dispersion; wide band; ABCD; Astrometry 



I. OVERVIEW 

Angular astrometry with long-baseline interferometers 
is based on planar trigonometry and measures baselines 
and path delays. The metric of path delays may be de- 
rived with sub-wavelength resolution if the fringe am- 
plitude is fitted to a local, monochromatic oscillation. 
This paper is an extended comment on the meaning of 
the wavelength and phase of this fit. Astronomical in- 
terferometers are generally built to accept large spectral 
band widths to enhance sensitivity at low light levels; 
the terminology of "mean" and "effective" wavelengths 
must be attached to well-founded statistics (integrals) 
over the broad-band spectra, in particular if the narrow- 
band concept of the group delay is used to describe the 
propagation of light through delay lines filled with air. 

Chapter |TT] is a tutorial on the group delay concept 
of waves traveling through a dispersive medium. Chap- 
ter Mil is a review of the role played by the fringe phase 
to reconstruct external path differences of star light ap- 
proaching two telescopes (the long-baseline interferome- 
ter) . The case of mapping the entire K band of the near 
infrared on a single detector channel is used as a numeri- 
cal example for fringe patterns generated by a wide band 
pass. Chapters II VI and W\ describe a single channel and an 
ABCD type of measurement of raw data and focus on the 
deconvolution within the data reduction process which 
separates spectral intensities (visibilities) from phases. 
Chapter I VII shows examples of the variation of the pivot 
(mean) wave number — reduction of the mean correlated 
flux to a single representative spectral line — as a function 
of star spectral indices and atmospheric transmission. 



II. WAVE PACKETS 

A. Polychromatic Wave Trains 

The linear superposition of two electromagnetic fields 
of angular frequencies lo\ — v p k\ and L02 = v p k2 traveling 
at a common phase velocity v p generates frequencies at 
the mean and the difference, 



COs(fciX — U>it) + COs(k 2 X — L02~t) = 

[k\{x — v p t)] + cos[fc2(x — v p t] — 
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(This is rather arbitrarily written in terms of cosines, not 
sines, to simplify embedding into a complex valued nota- 
tion.) The combined carrier frequency (cJi+W2)/2 is close 
to the carrier frequency of the individual components; the 
new aspect is the amplitude modulation at the difference 
of the frequencies. Adding more waves of comparable 
magnitude grows a few periodic pulses at the expense of 
increasingly more and more of the low-frequent pulses. 
Figure [T] demonstrates this bunching, starting with the 
example of a pulse train with a spacing of 0.1 Hz for the 
superposition of two frequencies at 1 and 0.9 Hz. The 
maxima with a period of 20 s become dominant after 
adding 0.85 Hz, and the period of the strongest maxima 
is eventually stretched to 40 s as the common divisor of 
the frequencies becomes 0.025 Hz. 



B. Group Velocity 

The transition from a discrete spectrum to a contin- 
uous spectrum depletes all pulses in the wave packet; 
essentially one remains with a carrier frequency repre- 
senting a mean of the frequencies in the wave packet, 
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FIG. 1: Top: a monochromatic wave at 1 Hz. Second from 
top: a superposition of two waves of equal amplitude at 1 and 
0.9 Hz. Below: the sum of three waves at 1, 0.9 and 0.85 Hz. 
Bottom: Four waves with differences of 0.1, 0.05 and 0.025 
Hz in frequency. 



and an envelope (hull) spreading inversely proportional 
to the width of the spectrum. The apparent velocity v g 
of this wave packet is defined by virtually marking some 
point with amplitude S(x,t) at location x and time t, 
waiting for a time interval At, and measuring by which 
distance Ax it has been moved: 



S(x, t) = S(x + Ax, t + At). 



(2) 



The sum of the discrete polychromatic spectrum has be- 
come a Fourier integral for the continuous case, S(x, t) = 
J j^e tkx ~ luJt S(k, lj). If we use the condition of station- 
arity, Eq. ©, in the Fourier representation, 
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we may expand S(k, uS) in the exponentials around pivot 
values fco and ujq representative of the center of the spec- 
trum, 



ikAx—iuAt 
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x [1 + i(k — k )Ax — i{uj — uj )At + 



The leading term in this expansion ensures that is 
valid to the order that does not depend on Aa; and At. 



The group velocity is defined as the "observed" motion 
v g = liniAf^o Ax /At. To fulfill (01 also to the linear 
order 0(Ax, At), the eliminating constraint becomes 

i(k - k )Ax - i(uj - oj )At = 0. (5) 

Division through iAt and i(k — k ) means [11] §1-3-4] 

ui — UJq 
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die' 



(6) 



The transition from the quotient to the differential im- 
plies that the band width is small in the sense that (i) the 
additional variation of S(k,Lu) in the kernel of is neg- 
ligible, and (ii) the second and higher order derivatives 
of the eigenmodes oj{k) are also negligible. 



C. Group Refractive Index 

The microscopic absorption and emission processes 
of an electromagnetic wave passing through gaseous 
or condensed matter can be summarized as a wave- 
length dependent refractive index n(k,u>); in the long- 
wavelength limit — i.e., A = 2n/k much larger than the 
inter-molecular distance or lattice unit cell — the super- 
position of many of these elementary processes replaces 
the vacuum wavelength by eigenmodes of the dispersion 



ck = n(k, u>)u). 



(7) 



Division through kn replaces the vacuum phase velocity 
c by the phase velocity 
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The concept of the group refractive index transforms 
this pair of variables v p and n further to a pair of vari- 
ables v g and n g to acknowledge that the relevant speed 
of fringe packets switches from v p to v g : If the setup is 
concerned with moving them through different geometric 
paths and monitoring a high coherent signal at a detec- 
tor position, the geometric path lengths must involve v g 
to synchronize the times of arrival to achieve interference 
near the detector. To switch from (v p ,n) to (v g ,n g ), © 
is rewritten to define the group refractive index n g , 



(3) The derivative of ([7]) w.r.t. k is with 
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This equation is solved for v g and inserted into 
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This equation is accurate, see Eqs. (4)-(5) in [lj| and 
Eq. (3) in pj| . Assuming weak dispersion, its geometric 
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series expansion in powers of the small dn/dk may be 
truncated after the linear term: 
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which is the version in [Tj, p. 1666] and [38], p. 768]. The 
relative error in (|12p is approximately the first neglected 
order, (§£ £ ) 2 = (§^) 2 where a = fe/( 2 = 1/A is 
the spectroscopic wave-number. In the K band around 
a w 4400 cm^ 1 at air pressures around 750 hPa, a typical 
value is dn/da ~ 1.2 x 10" 10 cm, which yields a relative 
error « 2 x 10" 13 . In the N band [H |M H3, HI , the 
relative error would still be tiny. 

A short-hand with one (and more) primes as in 



n'(k) — dn/dk 



(13) 



will subsequently be used to represent the first (and 
higher) order derivatives w.r.t. k. 
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FIG. 2: A prototypical infrared dispersion of humid air at 
p = 744 hPa, T = 16 °C and 10% humidity in the K band 
around 4500 and the H band around 6500 cm - . 



D. Time Delay 

A group delay t g is implicitly defined via ([5]) as the time 
At for a fixed Ax. Again in the limit of small deviations 
from a reference (A:o,ciJo), this becomes 



A 9k 

t 9 = Ax-. 



(14) 



The derivative of ©, k — uo/v pi with respect to oj is 
dk/duj = 1/vp — (u}/vp)(dv p /duj) and inserted, using t = 
Ax/vp for the un-dispersed reference time delay, 



. 1 
t„ = Ax — 



. u! dv v 
As— 



t dv 



t> 2 8lu 



At fixed Ax 
zero, tdvp + 
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the total differential of x = tv p must remain 



Vpdt 



0, which is used to substitute tdv„ ~» 
and to recover the Meisner formula [3J| 
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III. SYNTHETIC BROAD-BAND FRINGES 

A. Model Air Dispersion 

In the numerical examples that follow, a model of the 
refractive index n in the near-infrared is needed. It is 
demonstrated in Fig. [2] calculated from an update of an 
oscillator strength summation [3Cl ] . Since we also employ 
integrations over the dispersion spectrum, it is favorable 
to replace this detailed spectrum by a fit, explicitly 



n - 1 = 



Ci(T,p, H) 



c i (T,p,H)(a-<r ief ) i ; (17) 

i=0,l,... 

c iiei + CiT (i--r;) 

+c iH (H - H Iei ) + c lp (p - p lef ) . (18) 



Here, T is the absolute temperature with a reference 
value of T rc f , p is the air pressure with a reference value 
set at p le f, H the relative humidity between and 100 
with a reference value set at Href , cr is the wave- number 
with a reference value set at cr rc f , and Ci are the expansion 
coefficients of Table |U 
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TABLE I: Fitting coefficients for the multivariate Taylor ex- 
pansion (|18p to the real part of the index of refraction for 
T rcf = (273.15 + 16) K, p_ ref = 74400 Pa, H Ici = 10 %, 
<j rcf = l/(2.25/im) = 4444.4 cm" 1 , 1.3 ^m <= l/a <= 2.5 
/im. 



The coefficient cor means a change of the temperature 
by AT = 1 K changes = by 10" 5 K" 1 , changes 
n by 6 x 10" 7 and relocates the wave packet by 60 /im 
after a path of 100 m if A = 2.25 /im. The coefficient cqh 
means a change of the relative humidity by 10 percent 
points changes n by 0.9 x 10" 7 and relocates the packet 
by 9 am over the same path at the same wavelength. 
Introducing the fit replaces Fig. [2] by Fig.[3J 
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FIG. 3: The lower line is n fitted to Fig. [2] according to (fT8|) ; 
the upper line is n g = n + n'k derived from this fit according 
to (pi 



B. Model of Two-beam Interference 
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FIG. 4: Black body spectral densities 2%hu 3 /[c 2 ( e h " ,kBT -1)] 
between 1.52 and 2.78 /im on a semi-logarithmic scale, where 
h are the Planck and ks the Boltzmann constant. 



Illuminated by a source with coherent spectral energy 
density e(k), the superposition of the light with a second 
beam forced to a detour of a compensating geometric 
path length Di yields a fringe pattern 

A(Di) = J e(fc){l + cos[n(fc)fcA - kD e ]}dk, (19) 

assuming no correlation between the fields (amplitudes) 
at different k. D e is the (vacuum) delay imprinted on 
the two beams at arrival of the two telescopes, essentially 
the dot product between the baseline vector and a unit 
vector into the pointing direction Q. (The wavelength 
dependence of D e from lensing effects by the atmosphere 
above the telescopes [1, H^, |3l| and piston fluctuations 
are ignored here.) 

Di is the "internal" geometric path difference added by 
the mirror train on the ground, and nDi the associated 
optical path difference, which is controlled as to steer the 
phase of the cosine to some desired value in some average 
sense. The coherent flux e(fc) is the one experienced by 
the detector which produces the signal A J43|: it is the 
product of (i) the star emission, by (ii) the Earth's sky 
transmission (l~7| , by (iii) the reflectivity of mirror optics 
and transmissivity of beam combiner optics, including 
vibrations and diffraction effects [4(J, and by (iv) the 
coupling efficiency of any fiber optics and quantum effi- 
ciency of the detector, including tilt effects We will 
represent the star emission by black body spectra of Fig. 
IU the sky transmission by the model of Fig. [5j ignore 
chromaticism of the transmission of intermediate optics 
and use the quantum efficiency of Fig. [5] 

A different approach to delay compensation establishes 
the term nDi with a dispersion compensator [6|, |26|. 4511 . 
This trades the variability of the air dispersion [2l| by 
the dependence of the glass dispersion on temperature 
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FIG. 5: Synthetic Mauna Kea sky transmission in the K 
band at an airmass of 1.0 and a 1.6 mm water vapor column 



and expansion coefficients [10( and is not discussed here. 

As a model of the band pass [specification of the in- 
tegration interval in (|19|) ] we will use parameters that 
follow from placing an Infrasil [20l | prism of a wedge an- 
gle of 11.9° in front of the detector, and reverse inter- 
polation of the formula of the refraction angle [t| [l8[ 0, 
§4.7.2]. An extreme setup in terms of band pass width 
would map the entire K band from 2.05 to 2.45 um onto a 
single detector pixel with output A. The non-linearity of 
the prism equation and prism material dispersion would 
map most of the H band onto one of the side channels, 
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FIG. 6: Quantum efficiency of the 256x256 Rockwell PIC- 
NIC detector. 



wedge (°) incid. (°) 


# pixels 


limits (nm) 


11.9 


8.4522 
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1.52 


2.05 2.45 2.78 


22.59 


10.0084 
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2.05 


2.26 2.45 


31.7 


14.3783 
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2.05 


2.19 2.32 2.45 


39.04 


18.173 


4 


2.05 


2.15 2.25 2.35 2.45 



TABLE II: The spectral range of detector pixels if the wedge 
angle of the prism is increased for higher dispersion, and the 
incidence angle is chosen to stay with a minimum total deflec- 
tion angle between the direction of incidence and the direction 
of exit. The calculations are for Infrasil assuming that each 
pixel is equivalent to 0.0014077 rad difference in the exit an- 
gles. 



nulling the phase and this cohercncing is symbolized by 
the difference between Fig. [5] and Fig. [5] Setting Di to 
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FIG. 7: Prototypical model of e(k) constructed as a product 
of Fig. [5] Fig. [6] and a black body of 8000 K or 9000 K. 



as summarized in Table [TT1 

The main advantage of wide-band detection is the in- 
crease of the signal A given limited intensity e and noise 
by photon noise, detector readout and thermal back- 
ground. The focus of this work here is to point at some 
inherent disadvantages. 



C. Delay Tracking 

The philosophy of coherencing is to actuate the de- 
lay line (DL), the variable Di, to manipulate the phase 
difference 



f(k) = nkDi — kD e 



(20) 



in (|19p . Tracking on a local maximum (peak) of A would 
try to achieve a broad maximum or minimum of (p as 
a function of k, since the nearby spectral elements of 
e(k) then all add up "in phase." The difference between 
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FIG. 8: The residual phase tp(k) for a geometric delay D e = 
100 m as a function of a — fc/(2-7r): The solid line is for 
10% humidity at 744 hPa, 16°C and A = 99.980 044 790 m. 
The dashed line for 20% humidity at the same pressure and 
temperature and Di = 99.980 053 689 m. The Di are chosen 
as to achieve a common zero at A = 2.25 /im (cr = 4444 
cm -1 ); the 9 fj,m difference between the Di corresponds to 
cqb of Table U 



steer ip(k) close to zero as in Fig. [8] accumulates phases in 
the integral (fTS)) that differ by a few hundred degrees if 
e(k) covers a broad range of the spectrum. To achieve less 
chaotic/oscillatory behavior of the integrand, one would 
move Di to achieve a flatter ip(k) to reach Fig. [9] (see 
,4fJ| for N band examples). The spectral elements in a 
small interval of similar ip(k) interfere positively. The 
extremum of f(k) pinpoints the "effective" wave-number 
because the populated density of tp-states is largest there. 
Mathematically speaking, the extremum is characterized 
by a vanishing derivative of (12TJ)) , 



dip 
~dk 



n'kD l + nDi - D e 



(21) 
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FIG. 9: The phase tp of ([20} for a geometric delay D e = 100 
m as a function of wave-number: The upper plot is for 10% 
humidity at 744 hPa, 16 °C and A = 99.97999 m. The lower 
plot for 20% humidity at the same pressure, temperature and 
Di. 



Solving this for the geometric compensating path Di with 
(fl~2l) yields 



D L = D e /n g 



(22) 



This verifies the claim of Section ftl Cl that n g is the scale 
factor to replace n in the realm of fringe tracking. In 
the limit of constant n g (k) and n(k), the fringe pattern 
A of IT9|) is an ordinary Fourier Cosine Transform of the 
source spectrum e(k), its Michelson interferogram. 

Apart from a sign flip and scaling_with D e , Fig. [§] 
is equivalent to the upper part of [lfl Fig 1]: Their 
fringe tracking selects a minimum of Fig.[5]by moving Di, 
then chooses another (but unique) </3 gu ; in the two adja- 
cent spectral channels to define "guiding" wave-numbers. 
However, Fig. [5] points at a prospective problem with 
large band passes: such a pair of wave- numbers may not 
exist in the two neighboring channels when nonlinear dis- 
persion, i.e., n"(k) ^ 0, may create a non-parabolic shape 
of (p(k) such that no two solutions to (f(k) — 9s gu i may 
exist due to the additional extremum. 
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FIG. 10: Normalized K band fringe A(Di)/eo according to 
Eq. (O for the 8000 K spectrum of Fig. [7] for the three bands 
of the first line in Table [TT] at an external delay of D e = 100 
m, including nonlinear air dispersion n(k). 



(UHJ) becomes zero. If one assumes a constant refractive 
index n(k) inside the band, this is 



A = D e /n(k). 



(23) 



The relative error of this formula in comparison with the 
more accurate is n g (k) — n(k), typically the distance 
of 4 x 10~ 7 between the curves in Fig. [3] 



IV. BEYOND THE GROUP DELAY 
APPROXIMATION 

A. Moment Expansion 



D. Numerical Examples 



Nonlinear Dispersion 



Fig. [10] and [TT] show examples of the interplay of the 
8000 K spectrum of Fig. [7] with the dispersion of Fig. [3[ 
integrated over three adjacent intervals as specified by 
the first line of Table UTI The middle plot illustrates how 
the deep cut in the spectrum from 1.8 to 1.9 ji initiates 
a break-up of the main envelope into fragments in some 
sort of restoration of the multiple packets scheme that 
was the foundation of Fig. [TJ 

The roughest estimate of the position Di of the fringe 
center — ignoring the effect of the weighting with the star 
color e(k) — is where the argument of the cosine of Eq. 



Up to here, we have focused on the dispersion n(k) 
as the key parameter to locate the fringe packet. In 
practise, the "astrometric" interpretation of the interfer- 
ometric datum A is concerned with the recovery of the 
external delay D e given A and Di as the raw data. (In 
contrast to the "imaging" experiment which tries to mea- 
sure the magnitude of A as a function of D e , this quest 
is complementary as it aims at determining where on the 
D e axis the zero optical path difference is, rather than 
determining the degree of coherence that would repre- 
sent the star's brightness distribution.) The key subject 
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FIG. 11: The calculations of Fig. [10] repeated for a vacuum 
delay of D e — 50 m. 



of this paper is the additional role of the spectrum e(k) 
and its interplay with the dispersion when the weight- 
ing with the correlated flux lets the "observed" phase of 
A(Di) deviate from the "guiding" phase of an extremum 
of <p(fc). 

To understand this phenomenon, one introduces a Tay- 
lor expansion of the dispersion expansion around some 
"central" value k in the spirit of Filon quadratures [23[ , 



n(k) 



n(k) + (k- k)n\k) + ^ ^-n"{k) 



(k - fc) 3 
6 



n" (k) 



Higher order derivatives are 

n g (k) 
dng 
dk \k 



n(k) + kn'(k), 



n' g (k)=^£ T = 2n'(k)+kn"(k), 



3n"(k) + kn"'(k). 
Quick calculations use Table |T| 



l_(dn 
2tt V da 



da 2 



(24) 

(25) 
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(27) 

(28) 



-(0.113225 x 10" 9 - 4444 x 0.438 x 10" 14 )cm 

7T 



3.0 x 10 _13 m, 



(29) 



for example. Equivalent expansion of e(k) defines the 
moments of the energy spectrum, 



e(k){k - k) m dk 



(30) 



around any chosen center k [471 ]. For pure black body 
spectra, e rn is a binomial sum over Debye functions up 
to order 3 + m [l|, §27.1]. 



2. Asymmetric Coherent Spectra 
Eq. (|19p is accordingly expanded up to third order in 

A(Di) « { 1 + cos[n(k)kDi - kD e ] } e 
- {[n'(k)k + n(fc)]A - D e ) sin[n(fc)fcA - kD e ] ei 

1 - - 2 ___ 

-- {[n'(k)k + n(k)]Di - D e } cos[n(k)kDi - kD e ]e 2 

--[n"(k)k + 2n'(k)]Di sin[n(fc)feA - kD e ]e 2 

-- {[n'(k)k + n(k)]Di - D e ) [n"(k)k + 2n'{k)] 
xDi cos[n(k)kDi — kD e ]e 3 

1___ o 

+ - {[n'(k)k + n{k)]D t - D e } sm[n(k)kD t - kD e }e 3 

— [n'"(k)k + 3n'\k)]DiSm[n(k)kDi - kD e ]e 3 + OfelRl) 
6 

~ [l + cos ip(k)] e — [n g (k)Di — D e ] eisimp(k) 

1 - 2 
-- [n g {k)Di - D e ] e 2 cos<p(fc) 



n' g (k)Die 2 sinip(k) 



-- [n g (k)Di - D e ] n' g (k)Die 3 cos <p (k) 

1 - 3 

+- [n g {k)Di - D e ] e 3 simp(k) 

-g<(fc)Ae 3 sm<p{k) + 0(e 4 ). 
If we gather cosine and sine coefficients in the form 
A = e + C cos tp(k) — S sin (p(k) 



(32) 



(33) 



with 
C 



1 - 2 

e o _ 2 [ n g{k)Di — D e ] e 2 



1 



[n g (k)Di - D e ] n' g (k)Die 3 



(34) 



evaluated at a rc f is 
1 



2tt 



(2ci rc f + 2(T rc fC2ref) 



S = [n g Ck)D l -D e ]e 1 + -n' g (k)D l e 2 



[n g (k)Di - D e ] 3 e 3 



■(35) 
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the fringe packet is cast into a monochromatic format, 



B. Effective Wave- number 



A = e + VC 2 + S 2 cos^(fc) + (36) 
and rigorously defines an "observed" phase ip(k) + (pi, 
tfmipi = S/C. (37) 

3. Remark on Nomenclature 

The standard use of the word "dispersion" in the realm 
of refractive indices is the prismatic dispersion due to 
n'(k) =/= 0. Linear dispersion may then describe a lin- 
ear relation between the refractive index and wavelength 
(called first order dispersion in (33l. [3^|) or between re- 
fractive index and wave- number. For the theory de- 
scribed here, we will obviously use the latter, also keep- 
ing in mind that a Sellmeier functional description near 
resonances of Lorentzian shape would support this as- 
sumption. The goodness of fit of the actual air refrac- 
tive index to either dn/dX « const or dn/dk ss const is 
coincidental: whereas Fig. [2] indicates that dn/dk is ap- 
proximately constant in the K band, the equivalent plots 
at longer infrared regions are more complicated, see Fig. 

EH 




500 1000 1500 2000 2500 3000 3500 4000 
a (cm" 1 ) 

FIG. 12: The continuation of Fig. [3]into the mid-infrared. 



For the wave packet analysis, the focus shifts from n{k) 
to n g (k) and its derivatives. Eq. (|26|) proves that a linear 
dispersion in the sense of n"(k) — induces a linear 
dispersion n' g (k) = at the same k. However, Fig. [3] 
demonstrates that the nonlinearity of n g has a tendency 
of being stronger than the nonlinearity of n, inherited 
from the admixture of higher derivatives of n in the last 
terms of Eqs. ([25)1 - |27|) . The curves of constant group 
delay n' g (k) = are of the form n(k) = f/k + with 
constants / and n^, which means they need linearity 
between n and A. 



1. Choice 

The fringe packet lives at the DL position Di where the 
amplitude (C 2 + S 2 ) 1 ^ 2 of (f3"6")> is maximum, which means 
C and S should have no linear terms in the vicinity. The 
dominating non-constant term tx e 2 in (|34[) has already 
a quadratic form. The dominating leading term cx e\ in 
(I35p has a linear component in Df, from there we may 
summarize the rationale of group delay tracking: 



enforce 



by choosing 



k = 



ei = 



/ ke(k)dk 



27TCT 



(38) 



(39) 



• set Di according to (|2"2"|) such that the value of C 
falls off quadratically from eo; the factor in front of 
the term cx of (|34|) and the cubic factor in one 
of the terms cx e% of (|35|) become zero. 



/ e{k)dk 

as the effective center of the band, then 



As a by-product, the term cx S becomes small. With 
(|37p . tfi becomes close to zero, and the remaining oscilla- 
tion cx cos (p(k) show that the definition (|39p has indeed 
picked up the very point k of the spectrum where the 
phase ip calculated from n assumes the value of the entire 
wave packet represented by n g . The distances between 
the lobes are characterized by Atp(fc) = 2tt which implies 
A A = l/[an{a)]. 

In this approximation, the fringe envelope in (|36[) is 
\/(C 2 + S 2 ) w C w e - \{n g D l - D e ) 2 e 2 , which recovers 
a well-known estimate for the package width: The half 
width at half maximum is defined as C drops from eo to 
eo/2, which happens at (n g Di~ D e ) 2 — e^je-i. Therefore 



D 



FWHM 



2y / e /e 2 



(40) 



is the full width at half maximum. If the spectrum is flat 
over its full width fc FW , e[k) = I for \k - k\ < fc FW /2, 

the moments are eo = Ik FW and e 2 — I /_ fe Fw/ 2 k 2 dk = 
7(fc FW ) 3 /12 to give 



D 



FWHM 



e 2 /e = (fc* w )7l2 



1 2^3 1 



2V12 



k FW 



r FW 



1.1 



(41) 



(42) 



This results in a package length of £) FWHM = 14 ^ m if 
applied to a full K band width of er FW w 800 cm -1 = 
8 x 10 4 m -1 , for example. Eq. (|4"2")) is the uncertainty 
relation for the Fourier-conjugated variables a and Di in 
the specific case of a boxcar spectrum. 
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2. Definition 



Note that the variable 



J e(X)Xd\ 
fe(\)d\ 



(43) 



is not used and that A ^ 2ir/k because A = 2ir/k means 
dX/X = —dk/k but AdA —kdk [35|. The relation is 



2n 



r e(J£l 
J fc 2 



k 2 dk 
lei 
k e 



2tt 1 
T ~ 



3. £x 

k e 



6 e 2 
fc 2 e 



1 - 



1 - 

3 e2 
A: 2 e 



fc e 



3 e 2 
fc 2 e 



(44) 



which means with (|38|) that A > 1/a since e2 and e are 
moments of even order and positive, and that neglect of 
the term oc would underestimate a. 

With the estimate (|4ip for a flat spectrum, the relative 
correction is of the order of 3e2/(fc 2 eo) « (& FW /fc) 2 /4, 
or 1/400 for a relative band width of 1/10. Confirmed 
numerically, erroneous use of 1/A for a yields values that 
are typically 11 cm -1 off the correct a of the K band 
center pixel in our wide-band example. 



C. Nonlinear Group Delay 

The chirps in the envelopes are caused by linear dis- 
persion (non-vanishing n' g ) and skew correlated spectra, 
i.e., non- vanishing e^. 

The moment expansion has so far recovered the famil- 
iar equations (f2"2")) and (|3"9"|) on the basis of neglecting the 
four terms in (f3~4")) - (l3"5"l) with factors n' g and/or e%. The 
largest term of these is the one S oc e2 . Besides increasing 
the amplitude of A [H, [2(| Hi[ , it only has a tiny effect 

on the location of the maximum, adding w D{^-) 2 — to 

' & v 2n g ' eo 

Di. All three neglected terms S oc e-i or S oc actually 
have negligible effect on the relocation of the envelope 
maximum, but the term C oc does have an effect. As 
a first new result of the moment expansion we find a 
corrected envelope location via 



d 
dD t 



C = 



; {[n 9 A - D e f e 2 + {n g Di - D e ] n' g D ie ^ = 
The solution Di to this equation slightly modifies 



Examples of reaching beyond the group delay approxi- 
mation in this fashion are provided in Tab. Hill related to 
Fig. [lOl The relative correction read from the last col- 
umn is of the order of 2 x 10 -9 , generating a correction to 
the group delay estimate of 200 nm for a 100 m delay, for 
example. The cases of Tab. II VI show that the corrections 
are reduced to a quarter of these values, if the band pass 
is reduced to half of this width. 



Star 


atmosphere 


a 


e3/e 2 


n' g (a) 




(K) 


sec z 


(mm) 


(cm" 1 ) 


(10 3 /m 


) (10- 13 m) 


(io- 9 ) 


8000 


1 


1.6 


4498.4 


-12.8 


3.2 


-2.05 


9000 


1 


1.6 


4499.0 


-13.2 


3.2 


-2.11 


9000 


1 


3.0 


4497.8 


-11.9 


3.2 


-1.90 


15000 


1 


3.0 


4499.6 


-13.0 


3.2 


-2.08 



TABLE III: Change of some variables of the group delay cor- 
rection (|46[) as a function of the black body temperature in 
the star model, air mass sec z and precipitable water vapor 
(PWV) of the atmospheric model, integrated over a band pass 
from 2.05 to 2.45 fim. 



Star 


atmosphere 


(T 


e3/e 2 


n' g {a) 




(K) 


sec z 


(mm) 


(cm" 1 ) 


(10 3 /m 


) (IO" 13 m) 


(IO" 10 ) 


8000 


1 


1.6 


4459.7 


-3.77 


3.0 


-5.66 


9000 


1 


1.6 


4459.8 


-3.87 


3.0 


-5.81 


9000 


1 


3.0 


4459.1 


-3.41 


3.0 


-5.12 


15000 


1 


3.0 


4459.6 


-3.70 


3.0 


-5.55 



TABLE IV: Change of some variables of the group delay cor- 
rection (|46|) as in Table [TTT1 over a band pass from 2.15 to 2.35 
/jm (from 4255 to 4651 cm -1 , <r FW = 395 cm- 1 ), a is close 
to drcf of Table ^ such that Tig is close to (|29[1 . 



Overall, this is a more systematic and consistent ap- 
proach than to correct the representative point k in the 
band for star spectra within the group delay approxi- 
mation [l6[. All effects which change the spectrum — 
categories listed in Section IIII Bl — are treated on equal 
footing. 

The group delay and the correction introduced above 
are only defined as some form of interpolation between 
the fringe peaks; they try to locate the fringe package 
envelope to higher precision than the scale defined by 
the fringe spacing [32] • 



J-> e x ~ 2 n 3 e 2 



1 



2m. £3. 

rig e 2 



De 



(45) 



where an "extended" refractive index n e emerges as 

e3 



n e (k) = n g (k) 



2e ; 



-n'Jk). 



(46) 



ABCD PHASE 



Achromatic Phase Rotation 



Four values called A, B, C and D originate from adding 
phases of 0, 7r/2, it and 37r/2 to the argument of the cosine 
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in Eq. $M 



A 
D 
C 
D 



e(fc){l + cos[n(k)kD t - kD e 





tt/2 

7T 

3tt/2 



}}dk. 



. (47) 

This writing adds an achromatic phase to the trigono- 
metric function, as if an ideal reversion prism ( [3a . |39() 
had been inserted in one of the telescope beams in front 
of the beam combiner to push the relative phase between 
the s- and p-polarized components of its fields b y tt/ 2. 

We are not discussing stepping methods 0, [3 HtJ 
which add a ladder of achromatic paths sdi (s — 
0,1,2,...) to Di. The stepping adds a chirped phase 
oc snkdi to the cosine of (|19p . In sufficiently narrow 
bands or when n(k) has a hyperbolic shape, both types 
of scanning may essentially be equivalent — putting aside 
the question of sensitivity to the polarization of the cor- 
related e(k). 



B. Moment Expansion 

1. Standard Formula 

We pursue the same moment expansion as in Section 
IIV Al up to the order of e 2 , 

A — C « 2eo cos (^(fc) 

-2 {n g (k)Di - D e ) ei sin^fc) 

- {n g (k)Di - D e } 2 e 2 cos^(fc) 
-n' g (k)Die2smip(k) + ---, (48) 

D — B ss 2eo sin (p(k) 

+2 {n g (k)Di — D e } ei cos (/?(&;) 

- {n g (k)Di - D e } 2 e 2 smip(k) 
+n' g (k)Die 2 cos <p(k) H . (49) 

When the choice is made again, the leading terms 
oc eo dominate A—C and D — B. The result of ne glecting 
all other terms is known as the ABCD algorithm [llLl42l. 
MM- 



tan (f 



ABCD 



(k) 



D-B 
A-C 



(50) 



The difference to dealing only with the signal A of (|36|) 
is that the information provided in the signals B to D 
allows to decouple the data into fringe amplitude and 
phase. In the following, complementarily to the contents 
of section ITvT we look at the reduction of this phase track- 
ing approach to the value of D ei the ultimate variable of 
astronomical interest. 

In this sense, the construction of the mean vacuum 
wave vector k of (|39|) selects that ray, spot or piece in 



the broad band spectrum which experiences the geomet- 
ric path delay D e above the atmosphere and then the 
optical path delay n(k)Di on the ground such that its 
residual phase equals the unwrapped ABCD phase (p. 
(Small corrections to this statement follow in Sect. IV Cl ) 
If one describes long baseline interferometry as the art 
of equilibrating the optical path difference nDi on the 
ground to the geometric path difference D e above the at- 
mosphere, this is only correct for one special k inside the 
broad-band spectrum. 



2. Delay Line Mirror Vibrations 

The implicit integration over varying delays caused by 
mirror surface vibrations on shorter timescales than the 
detector integration adds explicit time-dependence to the 
positions Di in the arguments of the trigonometric func- 
tions (p~9|) . On short timescales, these are to lowest order 
linear, Di — > Di + 2vt, where v is the velocity of the mir- 
ror surface. First-order expansion of the trigonometric 
function oc t yields no change because the integral over 
the exposure time, —t e /2 < t < t e /2, vanishes. Including 
the second order, the trigonometric functions are multi- 
plied by the factor 1 — (2nkvt) 2 /2, which looks like the 
lowest order of the familiar exponential Strehl factor of 
phase variance 2nkvt. 

The integral over the time interval t e result in a multi- 
plication of e(k) by 1 — w 2 igfc 2 /6. (Vibrations which are 
sensed by a metrology generate other effects [l4|.l Ex- 
panding this term around some k generates a common 
factor for eo to all four ABCD values of a band; it re- 
duces the measured visibility, but cancels when building 
the estimator (p ABCI} with (|50[) . The change of k and 
contribution to the moment e 2 , however, is one of the ef- 
fects that are covered implicitly by the present analysis. 
(Harmonic mirror vibrations could be treated as Strehl 
factors [3| emulated by Bessel Functions, which we do 
not detail further.) 



Nonlinear ABCD Phase 



Wideband phase correction 



If the first moment e\ vanishes (see Section HVB II) . 
the system of equations (f¥5|) — has the matrix-vector 
form 




(51) 



cos f(k) — sin 
sm.ip(k) 



cosy?(fc) I 



2e - [n g {k)D l - D e ] 2 e 2 
n ' (k)Die 2 



[In the interpretation of A — C as the p-component and 
the D — C as the s-component of the beams, the correc- 
tion by a (small) n' g Die 2 appears as a fake polarization.] 
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We multiply this equation with the inverse of the rotation 
matrix, introduce the dimcnsionlcss parameter 



c 



n' g Die 2 



2e - [rigDi - D e ] 2 e 2 ' 
and find, with tan^ ABCD = Y/X, 



tan ip(k) 



Y - X( t&n (p 



ABCD 



c 



YC + X l + Ctan<p ABCD ' 



(52) 



(53) 



Taylor expansion of the arctangent of this equation for 
small £ yields the corrected phase 



^(jfc) = <p Aiiw - arctan(C) 

« ^ ABCD ~C + ^C 3 + 0(C 5 )- 



(54) 



The sign of the correction demonstrates that the observed 
^abcd j g i ar g er than the phase f(k) assigned to the 
monochromatic reduction, if n' g > 0. This is expected 
because e 2 describes adding spectral elements symmetri- 
cally to both sides of k, and a positive derivative n' adds 
a term oc k 2 to the phase (|2T))) . which un-balances the 
otherwise symmetric weighting by e 2 in the statistics of 
the phase spectrum (|2"0"|) . 

The prototypical values for the example of spectra in- 
tegrated over from 4081 to 4878 cm" 1 (2.05 to 2.45 fim) 
of black body temperature from 6000 to 12 000 K are 
e 2 /eo 4.9 x 10 4 cm -2 [larger than the flat spectrum 
estimate of flUJ} at ct fw w 800 cm" 1 ], n' g « 3.2 x 10" 11 
cm from Table Hill and for Di = 100 m 



2 e y 



0.008 rad. 



(55) 



This phase correction of 0.008 rad equals a change in 
D e of 0.008/(2tto-) w 2.8 nm at a « 4500 cm" 1 . We 
observe that this correction from ^ ABCD to is only 
1.5 % of the one calculated for the envelope shift after 
(|46p. The wide band correction shifts the fringe enve- 
lope along the Di abscissa; the individual fringe lobes 
stay almost pinned. However, this result may be de- 
ceptive since the estimate (|55j) of ([52")) assumes that the 

term h ^ ngDl D ^ 62 in the denominator of (l52l) can be 

neglected. Since e 2 /(2e ) w 2/(Z)f WHM ) 2 as estimated 
in Section IIVB 11 this assumption is only valid if the 
tracking settles Di close to the envelope maximum, at 
n g D l - D e rs 0. Tracking a distance of i£)f WHM away 
from the maximum, i [ ra a-P» g e] e ? j s approximately |, 
and £ in ((55)) grows by a factor of 2, for example. So 
precise spectrum correction in the phase tracking needs 
some sort of group tracking assistance to produce the 
estimator of n g Di — D e to feed the estimation of £; if 



the expansion ([54]) breaks down because the correction 
£ becomes too large, one must turn to a self-consistent 
solution of ([52"]) and ([53")) where £ and <£>(fc) are both func- 
tions of the unknown D„. 



2. Imprecise Spectra 

A further source of systematic error is that k (the ef- 
fective star color) is not known exactly but only with an 
error Afe, which creates a residual e\ ~ e n A/c. The terms 
oc e\ in D — B and ^4 — C do not vanish exactly, and 
become 



X = 2eo cos <p{k) — 2eoAk[n g Di — D e ] sinip(k) + ■ ■ ■ , 
Y = 2eo sin tp(k) + 2cq Ak[n g Di — D e ) cos ip(k) + ■■■ . 

The format still fits into (|5 1 [) if we replace v! g Di& 2 
n' g Die 2 + 2eoAk(n g Di — D e ). The induced correction in 
the phase ([53)) is 



AC w Ak{n g Di - D e 



(56) 



Assuming again phase tracking allowing some ambiguity 
in the "best" lobe ("fringe jumps"), n g Di — D e will be 
of the order of 2A, approximately 4 x 10~ 4 cm in the 
K band. The required Afc < A(/(n g Di — D e ) follows 
from an allowable error A£ in the phase: a 10 % error 
in the phase, A£ = 0.63 rad, would admit an error of 
Afc « W w ,„°n-4— , which is Aa w 250 cm" 1 . This 



4xl0- 4 cm ' 



is a quarter of the full band width and therefore easily 
met. 

So on behalf of this particular wide-band correction 
to the ABCD phase, knowledge of the mean momentum 
number k is not a concern; the role of k in selecting n(k) 
is a different theme and turns out to impose stronger 
error bounds on k, as we shall see in Section fVTl 



VI. ASTROMETRIC APPLICATION 

A. Data Reduction 

If the fringe tracker locates the fringe package maxi- 
mum, the data reduction converts the delay line mirror 
position Di at that point into D e = n e (k)Di of (H5J. If 
the tracker senses the ABCD phase, the data reduction 
applies the correction (f5"4"]l and reduces (fT9)) to 



D e = n{k)Di 



y(fc) 

k 



(57) 



of (|20p. The task of disentangling the two terms in the 
cosine of (jT^j) is a key difference between an astrometric 
data analysis and a fringe tracker. 

In both cases, the delay line positions Di are proba- 
bly obtained from an auxiliary metrology system (which 
we did not address), and in both cases of the product 
n( e )(fc)Di enters the metrology reading such that it re- 
duces the errors if the metrology is already operating 
close to k. A mixed/hybrid operation of both methods 
is useful. The common well-known problem of both ap- 
proaches is the fluctuation of k as a function of the spec- 
tral shape of e(fc), which enters the data reduction di- 
rectly as k or indirectly as n e (k) , which we discuss in the 
final subsections. 
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B. Unknown Star Temperature 

1. Sensitivity 

This "well-known hybrid sensitivity of the central k to 
the spectral width and star color is estimated in Tab. 
IVl Naive scaling of the sensitivity proportional to the 
inverse squared width of the spectral channel turns out 
to be quite inaccurate. 



A range (/im) 


a (8000 K) Act (~» 9000 K) 


2.05 - 2.45 


4498.0 0.656 


2.05 - 2.26 
2.26 - 2.45 


4657.0 0.215 
4256.8 0.121 


2.05 - 2.19 
2.19 - 2.32 
2.32 - 2.45 


4724.7 0.102 
4440.2 0.068 
4197.6 0.054 


2.05 - 2.15 
2.15 - 2.25 
2.25 - 2.35 
2.35 - 2.45 


4766.0 0.054 
4549.0 0.045 
4350.9 0.037 
4169.4 0.031 



TABLE V: The sensitivity of the pivot wave number a to 
a change of the temperature of a pure black-body spectrum 
for different spectral resolution (subdivisions) of the K band. 
In accordance with Fig. [4] the mean wave number shifts to 
higher values for the increase from 8000 to 9000 K. 

Since Fig. [TS] will show that the curves become flatter 
at higher temperatures, the example at 8000 K is already 
some worst case. 



2. Phase Tracking 

The astrometric use of these results would concentrate 
on the estimate of D e and derive it from the measured 
phase via (|57p . The "direct scaling" error ivup/k from a 
poorly known star temperature T is the first order dif- 
ferential 

The term fyAT would be of the order of 0.7 cm -1 for 
an error AT w 1000 K, see the first line in Table [V] At 
100 m of delay, the term (p/(2n) would be w —29 cycles, 
see the lower graph in Fig. [5] Using in addition a 4500 
cm -1 , the "direct scaling" error ([58]) is AD e w — 10 nm. 



3. Group Delay Tracking 

If the data reduction uses ([45]) with (|46|) , the precise 
value of k determines where on the humid air dispersion 
curve n has to be read. Since k represents a spectrum, the 
number of spectral channels to represent the band takes 



influence on this knowledge of the differential index of 
refraction, as a higher number of spectral channels means 
less sensitivity to the star colors — this is essentially the 
same result as from comparison of Figs. 12 and 13 in [35| . 
Each change of a by 1 cm -1 induces a change of n by 
1.1 x 10 -10 , see circf of Table H] With the same error 
in ex ~ 0.7 cm" 1 derived from AT » 1000 K as in the 
previous subsection, the error in n reaches «8x 10 -11 , 
which is +8 nm of "indirect" error per 100 m of delay. 

This sensitivity to a change in a induced by a change 
in the star color is practically the same as in the previous 
section with the "Phase Tracking" reduction. [This is no 
coincidence. The condition (|2~lj) actually sets up ip to 
mediate this scaling: Consider the derivative d< %^ = 
- $ which becomes -X via pi]). Using (2DJ), the 
derivative can also be written 2Tr d<,nD x~ D °' > ~ 2nDj^. 

OCT 1 OCT 

This allows the substitution ~* -Aff in (EH} to 

prove equivalence of both error propagations.] 



C. Varying Air Mass and PWV 

The influence of variations in the precipitable water 
vapor (PWV) and air mass on the mean wave number in 
the spectral channels is investigated by considering Fig. 
[3]for water vapor columns of 1, 1.6 and 3 mm, and for air 
masses of 1 and 1.5. (See [l5j for a discussion of water 
vapor absorption in the infrared.) 



4501 




4493 1 1 1 1 1 1 1 1 

7000 8000 9000 10000 11000 12000 13000 14000 

T(K) 



FIG. 13: Black body spectra from 7000 to 14 000 K multi- 
plied with the air transmission spectrum for 6 pairs of PWV 
and air mass and multiplied with the detector quantum ef- 
ficiency define these effective wave numbers in the 2.05-2.45 
fim band according to (|39[) . 

Black body spectra from 1.52 /im to 2.78 /mi have 
been sliced into 20 000 virtual sub-channels, multiplied 
by the air transmission factors and with the detector re- 
sponse of Fig. [6] to yield representations e(k) as in Fig. 
[7] Summation of ([39]) over sub-channels creates Figs. [13] 
and [T?] The flatter lines in Fig. [H] show that the vari- 
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4647 



3 mm, 1 .5 



(2.05-2.26) n 




4259 



7000 8000 9000 10000 11000 12000 13000 14000 
T(K) 



ation of the central k as a function of the black body 
temperature is reduced efficiently if the band width is 
reduced — consistent with the calculations on pure black 
body spectra of Table [Vj 

The air mass controls the strength of the CO2 absorp- 
tion bands near 4850 cm -1 , and the PWV controls the 
termination of the atmospheric window near 4200 cm -1 
(Fig. I15p . Their asymmetric position in opposite cor- 
ners in the two bands explains the opposite signs of the 
gradients of a with respect to these two parameters in 
the two plots of Fig. [141 For this reason, splitting the 
original wide band does not desensitize a from the sky 
transmission parameters as easily as from the broad star 
spectra. 
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FIG. 14: The wide band of Fig.[l3]is split into two bands from 
2.05 to 2.26 /im and from 2.26 to 2.45 /im, leading to these 
new central wave numbers a as a function of star temperature, 
PWV and air mass. 
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VII. SUMMARY 



The effect of air dispersion on visibilities measured 
by two-beam astronomical interferometers is accompa- 
nied by effects of astrometric signature: Accumulation 
of dispersed phases over correlated wide-band spectra re- 
locates the maximum of the wave packet envelope as if 
the group refractive index n g had been replaced by an 
extended refractive index n e which equals the group re- 
fractive index n g augmented by a hybrid product between 
some spectral skewness and the dispersion dn g /dk of the 
group refractive index. The complementary influence on 
the phase calculated with the ABCD formula is typically 
much smaller. 

Not only the star spectrum but also the (variable) 
atmospheric conditions and other instrumental effects 
shape the source spectrum and play important roles in 
determining pivot wave- numbers of the spectral bands. 
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